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-Abstract- 

Motivated by the search for a logic for polynomial time, we study rank logic (FPR) which 
extends fixed-point logic with counting (FPC) by operators that determine the rank of matrices 
over finite fields. While FPR can express most of the known queries that separate FPC from 
Ptime, nearly nothing was known about the limitations of its expressive power. 

In our first main result we show that the extensions of FPC by rank operators over different 
prime fields are incomparable. This solves an open question posed by Dawar and Holm and also 
implies that rank logic, in its original definition with a distinct rank operator for every field, fails 
to capture polynomial time. In particular we show that the variant of rank logic FPR* with an 
operator that uniformly expresses the matrix rank over finite fields is more expressive than FPR. 

One important step in our proof is to consider solvability logic FPS which is the analogous 
extension of FPC by quantifiers which express the solvability problem for linear equation systems 
over finite fields. Solvability logic can easily be embedded into rank logic, but it is open whether 
it is a strict fragment. In our second main result we give a partial answer to this question: in the 
absence of counting, rank operators are strictly more expressive than solvability quantifiers. 

1 Introduction 

“Le roi est mort, vive le roi!” has been the traditional proclamation, in France and other 
countries, to announce not only the death of the monarch, but also the immediate installment 
of his successor on the throne. The purpose of this paper is to kill the rank logic FPR, in 
the form in which it has been proposed in j7], as a candidate for a logic for Ptime. The 
logic FPR extends fixed-point logic by operators rk p (for every prime p) which compute 
the rank of definable matrices over the prime held F p with p elements. Although rank logic 
is well-motivated, as a logic that strictly extends fixed-point logic with counting by the 
ability to express important properties of linear algebra, most notably the solvability of linear 
equation systems over finite fields, our results show that the choice of having a separate rank 
operator for every prime p leads to a significant deficiency of the logic. Indeed, it follows 
from our main theorem that even the uniform rank problem, of computing the rank of a 
given matrix over an arbitrary prime, cannot be expressed in FPR and thus separates FPR 
from Ptime. This also reveals that a more general variant of rank logic, which has already 
been proposed in Hamms and which is based on a rank operator that takes not only the 
matrix but also the prime p as part of the input, is indeed strictly more powerful than FPR. 
Our result thus installs this new rank logic, denoted FPR*, as the rightful and distinctly 
more powerful successor of FPR as a potential candidate for a logic for Ptime. 

A logic for polynomial time The question whether there is a logic that expresses precisely 
the polynomial-time properties of finite structures is an important challenge in the field of 
finite model theory mm- The logic of reference for this quest is fixed-point logic with 
counting (FPC) which captures polynomial time on many interesting classes of structures 
and is strong enough to express most of the algorithmic techniques leading to polynomial¬ 
time procedures [5]. Although it has been known for more than twenty years that FPC 
fails to capture Ptime in general, by the fundamental CFI-construction due to Cai, Fiirer, 
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and Immerman [3] , we still do not know many properties of finite structures that provably 
separate FPC from Ptime. The two main sources of such problems are tractable cases of 
the graph isomorphism problem and queries from the field of linear algebra. First of all, the 
CFI-construction shows that FPC cannot define the isomorphism problem on graphs with 
bounded degree and bounded colour class size whereas the isomorphism problem is known 
to be tractable on all classes of graphs with bounded degree or bounded colour class size. 
Secondly, Atserias, Bulatov and Dawar [2] proved that FPC cannot express the solvability 
of linear equation systems over any finite Abelian group. It follows, that also other problems 
from the field of linear algebra are not definable in FPC. Interestingly, also the CFI-query 
can be formulated as linear equation system over Ft |7 . 


Rank logic This latter observation motivated Dawar, Grohe, Holm and Laubner [7] to 
introduce rank logic (FPR) which is the extension of FPC by operators for the rank of 
definable matrices over prime fields F p . To illustrate the idea of rank logic, let <p(x,y) be a 
formula (of FPC, say) which defines a binary relation £ A x A in an input structure 21. 
We identify the relation with the associated adjacency matrix 


: A x A -*■ {0,1}, (a, b) 


1, if (a, &)6<p a 
0, if (a,&)*y> a . 


In this sense, the formula ip defines in every structure 21 a matrix with entries in 
{0,1} £ F p . Now, rank logic FPR contains for every prime p e Pa rank operator rk p which 
can be used to form a rank term [rk p tp(x,y)] whose value in an input structure 21 is the 
matrix rank of M v over F p (we remark that rank logic also allows to express the rank of 
matrices which are indexed by tuples of elements; the precise definition is given in Section |2j. 

It turns out that rank operators have quite surprising expressive power. For example, 
they can define the transitive closure of symmetric relations, they can count the number of 
paths in DAGs modulo p and they can express the solvability of linear equation systems 
over finite fields (recall that a linear equation system M ■ x = b is solvable if, and only if, 
rk(Af) = rk(Af|6)) 0. Furthermore, rank operators can be used to define the isomorphism 
problem on various classes of structures on which the Weisfeiler-Lehman method (and thus 
fixed-point logic with counting) fails, e.g. classes of C(ai)-F(urer)-I(mmerman) graphs [3JG] 
and multipedes mm- The common idea of these isomorphism procedures is to reduce the 
isomorphism problem of structures to a suitable linear equation system over a finite field. 
More generally, by a recent result (which is mainly concerned with another candidate of 
a logic for polynomial time Cl), it follows that FPR captures polynomial time on certain 
classes of structures of bounded colour class size. In particular, this holds for the class of all 
structures of colour class size two (to which CFI-graphs and multipedes belong). 

While these results clearly show the high potential of rank logic, almost nothing has been 
known about its limitations. For instance, it has remained open whether rank logic suffices 
to capture polynomial time, whether rank operators can simulate fixed-point inductions [7] 
and also whether rank logic can define closely related problems from linear algebra (such 
as the solvability of linear equations over finite rings rather than fields ®)- One particular 
intriguing question is whether rank operators over different prime fields can simulate each 
other. In other words: is it possible to reduce the problem of determining the rank of a 
matrix over F p (within fixed-point logic with counting) to the problem of determining the 
rank of a matrix over F 9 (where p,q are distinct primes)? To attack this problem, Dawar 
and Holm mm developed a powerful toolkit of so called partition games of which one 
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variant (so called matrix-equivalence games) precisely characterises the expressive power of 
infinitary logic extended by rank quantifiers. By using these games, Holm |T5] was able to 
give a negative answer to the above question for the restricted case of rank operators of 
dimension one. 

In this paper we propose a different method, based on exploiting symmetries rather than 
game theoretic arguments, to prove new lower bounds for logics with rank operators. In our 
main result (Theorem [3]) we prove that for every prime q there exists a class of structures 
K- q on which FPC fails to capture polynomial time and on which rank operators over every 
prime field F p , p + q can be simulated in FPC. On the other hand, rank operators over F g 
can be used to canonise structures in JC q which means that the extension of fixed-point logic 
by rk g -operators captures polynomial time on IC q . From this result we can easily extract the 
following answers to the open questions outlined above. 

(a) Rank logic (as defined in [7]) fails to capture polynomial time (Theorem [2|. 

(b) The extensions of fixed-point logic by rank operators over different prime fields are 

incomparable (Theorem [l]) , cf. pO, 8 . HB|. 

We obtain these classes of structures K q by generalising the well-known construction of 
Cai, Fiirer and Immerman [T|. It has been observed that their construction actually is a 
clever way of encoding a linear equation system over F 2 into an appropriate graph structure 
(see e.g. [H 0 [Kl [TB]). Intuitively, each gadget in the CFI-construction can be seen as an 
equation (or, equivalently, as a circuit gate) which counts the number of transpositions of 
adjacent edges modulo two, and the CFI-query is to decide whether the total number of 
such transpositions is even or odd. Knowing this, it is very natural to ask whether this idea 
can be generalised to encode linear equation systems over arbitrary finite fields or, more 
generally, equation systems over arbitrary (Abelian) groups. 

In [ 20 ] , in order to obtain hardness results for the graph isomorphism problem, Toran 
followed this idea and established a graph construction which simulates mod fc-counting 
gates for all k > 2. Moreover, in order to separate the fragments of rank logic by operators 
over different prime fields, Holm presented in m an even more general kind of construction 
which allows the representation of equations over every Abelian group G. In fact, we obtain 
the classes IC q essentially by using his construction for the special case where G = ¥ q . 

Solvability logic One important step in our proof is to consider solvability logic FPS which 
is the extension of FPC by quantifiers which can express the solvability of linear equation 
systems over finite fields (so called solvability quantifiers , see [SJ HEj) ■ Obviously the logic 
FPS can easily be embedded into rank logic (as rank operators can be used to solve linear 
equation systems), but it remains open whether the inclusion FPS < FPR is strict. To prove 
our main result outlined above we show that over certain classes of structures the logics FPS 
and FPR have precisely the same expressive power. In a more general context this might 
give some evidence that in the framework of fixed-point logic with counting rank operators 
can be simulated by solvability quantifiers. On the other hand we show in Section [4] that the 
extension of first-order logic (without counting) by solvability quantifiers is strictly weaker 
than the respective extension by rank operators. This last result thus separates solvability 
quantifiers and rank operators in the absence of counting. 

Let us briefly sketch the main idea of our proofs which is to exploit the symmetries of 
definable linear equation systems. To this end, let M ■ x = 1 be a linear equation system over 
some prime field F p where M is an / x /-matrix over F p and where 1 is the /-identity vector 
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over F p , i.e. l(i) = 1 for all i e I. Moreover, let T be a group which acts on / and which 
stabilises M, i.e. for all i,j 6 / and ir 6 T we have M(i,j) = M(Tr(i),Tr(j)). In other words, if 
we identify the elements ir e T with / x /-permutation matrices II then we have II • M = M • II. 
Now let 6 e be a solution of the linear equation system M ■ x = 1. Then we observe that 
also II • b is a solution for n € T since 

m • (n ■ b) = (m ■ n) • b = n • (m • 5) = n • i = i. 

In other words: the solution space of the linear equation system M ■ x = 1 is closed under the 
action of T. Such and similar observations will enable us to transform a given linear equation 
system into a considerably simpler linear system which still is equivalent to the original one. 


Logics with linear-algebraic operators 

By S(t) we denote the class of all finite, relational structures of signature r. We assume 
that the reader is familiar with first-order logic (FO) and inflationary fixed-point logic (FP). 
For details see HUH!. We write P for the set of primes and denote the prime field with p 
elements by F p . We consider matrices and vectors over unordered index sets. Formally, if I 
and J are non-empty sets, then an / x J-matrix M over F p is a mapping M:Ix J-» F p and 
an /-vector v over F p is a mapping v : I h* F p . 

A (linear) preorder <cdxionlisa reflexive, transitive and total binary relation. 
A preorder < induces a linear order on the classes of the associated equivalence relation 
x ~ y := (x < y A y < x). We write A = C 0 < ••• < C ra _i to denote the decomposition of A into 
—classes C.; which are linearly ordered by < as indicated. 

We briefly recall the definitions of first-order logic with counting FOC and (inflationary) 
fixed-point logic with counting FPC which are the extensions of FO and FP by counting 
terms. Formulas of FOC and FPC are evaluated over the two-sorted extension of an input 
structure by a copy of the arithmetic. Following [7] we let 21# denote the two-sorted extension 
of a r-structure 21= (A, Ri, ..., /?*,) by the arithmetic 91= (N,+,-,0,l), i.e. the two-sorted 
structure 21# = (A, Ri ,..., /?&, N, +, •, 0,1) where the universe of the first sort (also referred 
to as vertex sort) is A and the universe of the second sort (also referred to as number sort or 
counting sort ) is N. 

As usual for the two-sorted setting we have, for both, the vertex and the number sort, a 
collection of typed first-order variables. We agree to use Latin letters x, y, z,... for variables 
which range over the vertices and Greek letters v, /Li,... for variables ranging over the numbers. 
Similarly, for second-order variables R we allow mixed types, i.e. a relation symbol R of 
type (fc,£) e N x N stands for a relation R £ A k x Of course, already first-order logic 
over such two-sorted extensions is undecidable. To obtain logics whose data complexity is in 
polynomial time we restrict the quantification over the number sort by a numeric term t, i.e. 
Qv < t.ip where Q e {3, V} and where t is a closed numeric term. Similarly, for fixed-point 
logic FP we bound the numeric components of fixed-point variables R of type (k,£) in all 
fixed-point definitions 

[ifp Rxu < t. (<p(x, v))] ( x , v) 

by a tuple of closed numeric terms i = (t\,... ,tf) where each bounds the range of the 
variable v, in the tuple v. For the logics which we consider here the value of such numeric 
terms (and thus the range of all quantifiers over the number sort) is polynomially bounded in 
the size of the input structure. Together with the standard argument that inflationary fixed- 
points can be evaluated in polynomial time and the fact that the matrix rank over any field 
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can be determined in polynomial time (for example by the method of Gaussian elimination), 
this ensures that all the logics which we introduce in the following have polynomial-time 
data complexity. 

Let xv be a mixed tuple of variables and let i be a tuple of closed numeric terms which 
bounds the range of the numeric variables in v. For a formula p> we define a counting term 
s = [ffxv whose value s a e N in a structure 21 corresponds to the number of tuples 

(a, fi) e A k x such that 211= ip(a, fi) and n, < tf where k = |a;| and l = \v\. 

We define first-order logic with counting FOC as the extension of (the above described 
two-sorted variant of) FO by counting terms. Similarly, by adding counting terms to the 
logic FP we obtain (inflationary) fixed-point logic with counting FPC. 

Extensions by rank operators 

Next, we recall the notion of rank operators as introduced in [7J. Let Q(xv <t,yfi< s) be 
a numeric term where i and s are tuples of closed numeric terms which bound the range 
of the numeric variables in the tuples v and fi, respectively. Given a structure 21 we define 

:= {n e : rij < tf}. The set N~ s c is defined analogously. The term 0 defines in 
the structure 21 for I := x and J := A)^ x the I x J-matrix Mq with values in N 
that is given as Me(dn,6m) := (an, bin). 

The matrix rank operators compute the rank of the matrix Mq over a prime field F p 
for p € P. Firstly, as in [7], we define for every prime p a matrix rank operator rk p which 
allows us to construct a new numeric rank term [rk p (xv < t,yfi < s) . 0] whose value in the 
structure 21 is the rank of the matrix (Mq mod p) over F p . Secondly, we propose a more 
flexible rank operator rk* which gets the prime p as an additional input. Formally, with this 
rank operator rk* we can construct a rank term [rk* (xv < t,yfi < s,tt < r) . 0] where it is 
an additional free numeric variable whose range is bounded by some closed numeric term r. 
Given a structure 21 and an assignment tt h* p for some prime p < r a , the value of this rank 
term is the matrix rank of (Mq mod p) considered as a matrix over F p . The rank operator 
rk* can be seen as a unification for the the family of rank operators (rk p ) p6 p and has been 
introduced in mmm- 

We define, for every set of primes fi £ P, the extension FORq of FOC and the extension 
FPRq of FPC by matrix rank operators rk p with p e fi. For convenience, we let FOR = FORp 
and FPR = FPRp. Similarly, we denote by FPR* the extension of FPC by the uniform 
rank operator rk*. We remark, that rank operators can directly simulate counting terms. 
For example we have that 

[#x.ip( x)] = [rk p (x,y) . (x = y A ip(x))]. 

Hence, we could equivalently define the rank logics FORn, FPRq and FPR* as the extensions 
of (the two-sorted variants of) FO and FP, respectively. 

Extensions by solvability quantifiers 

It is well-known that the extensions of FOC and FPC by matrix rank operators have 
surprising expressive power which, in particular, goes beyond that of fixed-point logic with 
counting. For example, it is known that rank operators can easily define the symmetric 
transitive closure of binary relations and that they can be used to express the structure 
isomorphism problem on various classes on which the Weisfeiler-Lehman test fails like, for 
example, classes of Cai, Fiirer and Immerman graphs [am. Interestingly, such results for 
rank logic were obtained by reducing the respective queries to a solvability problem for linear 
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equation system over finite fields. Although the solvability problem (for linear equation 
systems) can be defined in rank logic, we propose to study extensions by quantifiers which 
directly express this solvability problem. One advantage of this approach is that one can 
naturally define such quantifiers for linear systems over more general classes of algebraic 
domains, like rings, for which no appropriate notion of matrix rank exists, cf. [6]. 

Let £ P be a set of primes. Then the solvability logic FPSq extends the syntax of FPC 
for every pell by the following formula creation rule for solvability quantifiers slv p . 

Let ip(xv,yji,z) e FPSn and let t and s be tuples of closed numeric terms with |f | = \v\ 

and |s| = \jl\. Then also ip(z) = (si m p xv <s,yji< i)<p(xv,yfl,z) is a formula of FPSn. 

The semantics of the formula ip(z) is defined similarly as for rank logic. More precisely, 
let k = |x| and i - \y\. To a pair (21, 5 >-*■ c) e §(cr, z) we associate the / x J-matrix M p over 
{0,1} £ F p where / = A k x N £s and J = A e x N s * and where for del and b e J we have 
M lp (a,b ) = 1 if, and only if, 211= ip(a,b,c). 

Let 1 be the /-identity vector over F p , i.e. 1(a) = 1 for all del. Then M v and 1 
determine the linear equation system M v ■ x = 1 over F p where x = (xj)j^j is a J-vector of 
variables Xj which range over F p . Finally, 211= -0(c) if, and only if, M v • x = 1 is solvable. 

At first glance, the solvability quantifier seem to pose serious restrictions on the syntactic 
form of definable linear equation systems. Specifically, the coefficient matrix has to be a 
matrix over {0,1} and the vector of constants is fixed from outside. However, it is not hard 
to show that general linear equation systems can be brought into this kind of normal form 
by using quantifier-free first-order transformations (see Lemma 4.1 in |Bj). 

We write FPS to denote the logic FPSp and FPS p to denote the logic FPS{ p j for p e P. 
Analogously to the definition of FPR* we also consider a solvability quantifier slv which 
gets the prime p as an additional input and which can uniformly simulate all solvability 
quantifiers slv p for p e P. Let FPS* denote the extension of FPC by this uniform version of 
a solvability quantifier. Then the following inclusions easily follow from the definitions and 
the fact that rank operators can be used to define the solvability problem for linear equation 
systems. 


FORp 

< FPRp 

< FPR < 

FPR* < Ptime 

VI 

VI 

VI 

VI 

FOSp 

< FPSp 

< FPS < 

FPS* 


VI 




FPC 




Finally we remark that, analogously to [7], we defined rank operators and solvability 
quantifiers for prime fields only. Of course, the definition can easily be generalised to cover 
all finite fields, i.e. also finite fields of prime power order. However, for the case of solvability 
quantifiers, Holm was able to prove in m that this does not alter the expressive power of 
the resulting logics since solvability quantifiers over a finite field F g of prime power order 
q = p k can be simulated by solvability quantifiers over F p . Moreover, a similar reduction 
can be achieved for rank operators which altogether shows that it suffices to focus on rank 
operators and solvability quantifiers over prime fields. 

3 Separation results over different classes of fields 

In this section we separate the extensions of fixed-point logic with counting by solvability 
quantifiers and rank operators over different prime fields. Specifically, we show that the 
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expressive power of the logics FPSq is different for all sets of primes Ll. Moreover, we transfer 
these results to the extensions FPRn by rank operators. In this way we can answer the 
following open question about rank logic: 

It holds that FPR p t FPR ? for pairs of different primes p,q. [5J H51IT5] 

Another important consequence of our result is that rank logic (in the way it was defined 
in 0) does not suffice to capture polynomial time. Let us state these results formally. 

► Theorem 1. Let LI + Ll' be two sets of primes. Then FPSn + FPSq' and FPRq + FPRq/. 

► Theorem 2. Rank logic fails to capture polynomial time. We have FPR< FPR* < Ptime. 
In fact, both theorems are simple consequences of our following main result. 

► Theorem 3. For every prime q there is a class of structures K. q such that 

(a) FPSq = FPC on K. q for every set of primes Ll with q£Ll, 

(b) FPRq = FPSn on K q for all sets of primes Ll. 

(c) FPC < Ptime on K q , and 

(d) FPS, = Ptime on K. q . 

Proof of Theorem [lj Let f l and Ll' be two sets of primes as above. Without loss of generality 
let us assume that there exists a prime q e LI \ LI'. Then by Theorem [3] there exists a class 
JC q on which FPSq = FPRn = Ptime and on which FPSn' = FPRn' = FPC < Ptime. « 

Proof of Theorem [2j Otherwise assume that FPR = Ptime. Then, in particular, FPR 
= FPR* and there exists a formula ip s FPR which can uniformly determine the rank 
of matrices over prime fields, i.e. which can express the uniform rank operator rk*. As 
a matter of fact we have <p € FPRn for some finite set of primes Ll. By using ip we can 
uniformly express the matrix rank over each prime field F p in FPRn- In other words, we 
have FPS < FPR < FPR* < FPR n . 

Now let q e P \ Ll. By Theorem [3] there exists a class of structures IC q on which FPRn = 
FPC < Ptime. However, the class K. q can be chosen such that Ptime = FPS g < FPRn on 
K. q by Theorem n@> and we obtain the desired contradiction. « 

The proof of Theorem [2] reveals a deficiency of the logic FPR: each formula can only 
access rk p -operators for a finite set Ll of distinct primes p. In fact, the query which we 
constructed to separate FPR from Ptime can be defined in FPR*. Altogether this suggests 
to generalise the notion of rank operators and to specify the prime p as a part of the input, 
as we did for FPR*, and as it was proposed in HBUMHH]. 

The remainder of this section is devoted to the proof of Theorem [3] We fix a prime q 
and proceed as follows. In a first step, we identify properties of classes of structures K. q 
which guarantee that the relations claimed in and hold. In a second step, 

we proceed to show that we can obtain a class of structures K, q that satisfies all of these 
sufficient criteria. This together then proves our theorem. 

Establishing sufficient criteria 

We start by establishing sufficient criteria for the most relevant part of Theorem [3] which 
is the relation claimed in Q. Assume that we have a class of structures K q = K. with the 
following properties. 
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(I) The automorphism groups A a := Aut(2l) of structures 21 e 1C are Abelian g-groups. 

(II) The orbits of /-tuples in structures 21 e /C can be ordered in FPC. 

Formally, for each / > 1 there is a formula ip<( x\,... , ye) e FPC such that 

for every structure 21 e 1C, the formula (p<(x,y) defines in 21 a linear preorder < on 
with the property that two /-tuples a,b e A e are <-equivalent if, and only if, they are 
in the same Aoi-orbit. 

► Lemma 4. If K, satisfies (Q) and then FPSo = FPC on K, for all Cl £ P \ {g}. 

The proof of this lemma is by induction on the structure of FPSn-formulas. Obviously, 
the only interesting step is the translation of a solvability formula 


ip(z) = (si Vp xv < s,yp< t)tp(xv, y\x, z) 

into an FPC-formula D(z) which is equivalent to if(z) on the class 1C. Let \x\ = |y] = /, 
\v\ = \fi\ = A and |z| = k. To explain our main argument, we fix a structure 21 e 1C and a 
fc-tuple of parameters c e which is compatible with the type of the variable tuple z. 

According to the semantics of the solvability quantifier, the formula ip defines in (21 ,z >-*• c) 
an I x J-matrix M = with entries in {0,1} £ F p where I = if ■= A f - x N Ss £ A e x N A and 
J = := A 1 x £ A* x N a that is defined for a € I and b e J as 

m f 1 ’ if 211= p(a, b, c) 

M( °’ i) = |o, else. 


By definition we have 21 t= ip(c) if, and only if, the linear equation system M ■ x = 1 
over F p is solvable. The key idea is to use the symmetries of the structure 21 to translate 
the linear equation system M • x = 1 into an equivalent linear system which is simpler in 
the sense that its solvability can be defined in the logic FPC. The reader should observe 
that each automorphism 7r e A^ = Aut(2l) naturally induces an automorphism of the two- 
sorted extension 21^ which point-wise fixes every number ueN. In particular we have 
Aut(2l) = Aut(2l # ). 

We set T = Tf := Aut(2l, c) < A = A a = Aut(2t). The group T acts on / and J in the 
natural way. We identify each automorphism ir e T with the corresponding I x /-permutation 
matrix 11/ and the corresponding J x J-permutation matrix IIj in the usual way. More 
precisely, to tt e T we associate the / x /-permutation matrix 11/ which is defined as 


II/(a, b) 


1, 7T (a) = b 
0, otherwise. 


Then T acts on the set of / x J-matrices by left multiplication with I x /-permutation matrices. 
Similarly, we let IIj denote the J x J-permutation matrix defined as 


n j(a,b) 


1, 7r (a) = b 
0, otherwise. 


Then T also acts on the set of / x J-matrices by right multiplication with J x J-permutation 
matrices. Specifically, for n e T we have (11/ ■ M)(a,b) = M(n(a),b) and (M-IIJ 1 )(a,/) = 
M(a,n(b)). Since M is defined by a formula in the structure (21, c) and since T = Aut(2l,c) 
we conclude that (11/ • M •Ilj 1 )(a,&) = M(n(a),Tr(b)) = M(a,b) and thus 

n, ■ M ■ II } 1 = M o Ui-M = M-Uj. 


This identity leads to the following important observation. 
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► Lemma 5. If M ■ x = 1 is solvable, then the system has a T-symmetric solution, i.e. a 
solution 6 e Fp such that IIj •b =b for all n € T. 

Proof. If M ■ b = 1, then also 11/ • (M • b) = 1 and thus M • (IIj • b) = 1 for all 7r e T. This 
shows that T acts on the solution space of the linear equation system. Since K. satisfies 
property ([!]) we know that T is a g-group for a prime q + p. Thus each T-orbit has size q r for 
some r > 0. On the other hand, the number of solutions is a power of p. We conclude that 
there is at least one T-orbit of size one which proves our claim. « 

Let 6 e Fp be a T-symmetric solution. Then the entries of the solution b on T-orbits 
are constant: for j 6 J and leT we have b(n(j)) = (IIj • b){j) = b{j). We proceed to use 
the property © and show that there exists an FPC-formula p<(x,y) which defines for all 
21 e /C and c e (A tu N) fc as above a linear preorder < on A 1 which identifies T-orbits. Note 
that, in general, T = Aut(2l, c) is a strict subgroup of A = Aut(2l). Thus we can not directly 
apply (lllh . However, the T-orbits on correspond to the A-orbits on A k where the first 
k' entries are fixed to the elements {ci,..., c*,} n A. 

The linear preorder < naturally extends to a preorder on the sets I and J with the same 
properties. Let us write J = Jq < J\ < ■■■ < J„_i to denote the decomposition of J into the 
T-orbits Jj which are ordered by < as indicated. Moreover, for j e [w] we let ej denote the 
identity vector on the j- th orbit Jj, i.e. the J-vector which defined for i e J as 


ej{i) := 



if i e Jj 


else. 


Let E denote the J x [aj-matrix whose j-th column is the vector ej. It follows that a 
T-symmetric solution b can be written as E ■ b* = b for a unique [v]-vector 6*. Together with 
Lemma [5] this shows the following. 

► Lemma 6. The linear equation system M • x = 1 is solvable if, and only if, the linear 
equation system ( M • E) ■ x* = 1 is solvable. 

Finally, we observe that the coefficient matrix M* := (M ■ E) of the equivalent linear 
equation system M* • x* = 1 can easily be obtained in FPC and that it is a matrix over the 
ordered set of column indices [v]. It is a simple observation that such linear equation systems 
can be solved in FPC: the linear order on the column set induces (together with some fixed 
order on F p ) a lexicographical ordering on the set of rows which is, up to duplicates of rows, 
a linear order on this set. Thus, in general, if we have a linear order on one of the index sets 
of the coefficient matrix this suffices to obtain an equivalent matrix where both index sets 
are ordered, see also HB|. This finishes our proof of Lemma g 


We proceed to show that the conditions ([!]) and @ also guarantee that rank operators 
can be reduced to solvability operators over the class /C. In fact, for this translation we only 
require the somewhat weaker assumption that we can define in FPC on ^-tuples in structures 
21 e JC a linear preorder in which every class can be linearised in FPC by fixing a constant 
number of parameters. The precise technical requirements will become clear from the proof 
of the following lemma. 

► Lemma 7. If K. satisfies |l]j and then FPRn = FPSn on K. for all sets of primes ft. 

Proof. We inductively translate FPRn-formulas into formulas of FPSq which are equivalent 
on the class /C. The only interesting case is the transformation of rank terms 


T(^) = [rk p {xv <t.,yp< s). Q(xv, yp, z)]. 
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Let |i| = |y| = £, \v\ = |/2| = A and |5| = k. Let 21 e K. and let c be a /c-tuple of parameters 
c€ (AtuN) fc which is compatible with the type of the variable tuple z. The term 0 defines in 
(21, z c) for J a = / := dJ®! x and J a = J := x the I x J-matrix M over F p which 
is dehned as 

M(ah,bfh) := 0 U (an,bfh,c) mod p. 

According to the semantics of matrix rank operators, the value T a (c) € N is the rank 
of the matrix M. We proceed to show that we can determine the matrix rank of M by a 
recursive application of solvability queries. To this end we make the following key observation. 

Claim: There are FPC-formulas ‘P<(yiPi,y 2 h 2 ), i><(v, Vihi, Z/ 2 M 2 ) such that for every 21 e K, 

(a) is a linear preorder < on J a , and such that 

(b) for every <-class [j] £ J a there exists a parameter tuple d e such that ipf(d ) is a 

linear order < on [j]. 

Proof of claim: First of all, we let ip< be an FPC-formula which defines in every structure 
21 e K, a linear preorder < on such that <-classes correspond to Ag-orbits. Such a 
formula exists by our assumption that K. satisfies property ©• Analogously, we choose an 
FPC-formula which defines in every structure 21 € /C a linear preorder <* on x J a that 
induces a linear order on the Aa-orbits. 

Now let [j] £ be a <-class for some 21 e /C. By property ([I]) we know that Aa is an 
Abelian group. Thus, each automorphism 7r e A^ which fixes one element in the Aoi-orbit 
[j] point-wise fixes every element in the class [j]. We conclude that the restriction of <* to 
elements in {j} x [j] corresponds to a linear order on [ j] for each j 6 [j]. In this way we 
obtain an FPC-formula tp< with the desired properties. h 

We are now prepared to describe the recursive procedure which allows us to determine 
the rank of the matrix M in FPSq. To this end we fix formulas <p< and ip< with the above 
properties. Moreover, let < denote the linear preorder defined by ip< on J and let 

J = Jq ^ Ji < ^ J r -1- 

We use the formula to obtain on each class Ji a family of definable linear orderings (which 
depend on the choice of different parameters). For j 6 J we denote by fhj e F p the j-th 
column of the matrix M. Then the rank of M coincides with the dimension of the F p -vector 
space which is generated by the set of columns {fhj : j e J} of the matrix M. 

Now, for i e [r] we recursively obtain the dimension di € N of the F p -vector space 
generated by Vi := {fhj : j e ,/ 0 u ,7i u • • • u ,/,} as follows. First, we use ip< to fix a linear 
order on Ji (the following steps are independent of the specific linear order and can thus 
be performed in parallel for each such order). Using this linear order on Ji we can identify 
in FPSo a maximal set W £ {fhj : j e Ji} of linearly independent columns such that 
(Vi- 1 ) n (W) - {0}. Indeed, if (Vi-i)n (W) = {0}, then for fh e {fhj : j 6 J*}, fhi (W) we have 
that (Vi- 1 ) n (W tu {fh}) = {0} if, and only if, fh £ (Vi -1 u W). Observe that the conditions 
m i (W) and fh p (Vi- 1 u W) correspond to the solvability of a linear equation system over F p . 
We claim that di = di -1 + \W\. Indeed, by the maximally of W and since (Vi- 1 ) n (W) = {0} 
it follows that (V,) = (U-i) © (W). Moreover, W consists of linearly independent columns 
and is a basis for (W). 

Since the above described recursion can easily be implemented in FPSn, we conclude that 
the rank d r -± of the matrix M can be determined in FPSn which completes our proof. ■* 
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We now focus on the parts Q and © of Theorem [3] and establish sufficient criteria 
which guarantee that FPC fails to capture Ptime on 1C while FPS 9 can express every 
polynomial-time decidable property of /C-structures. 


(III) There exists an FPS g -definable canonisation procedure on 1C. 

(IV) For every k > 1 there exists a pair of structures 21 6 1C and 25 e /C such that 21 f 23 

and 21 23. 


► Lemma 8. If K. satisfies (III) and | TV \) , then FPC < FPS 9 = Ptime on 1C. 


Proof. It is clear that by property (JIIIJ) we have FPS g = Ptime on 1C. Moreover, if we had 
FPC = Ptime on /C then, by the embedding of FPC into and the fact that /C-structures 
can be canonised in polynomial time, there exists a fixed k > 1 such that can identify 
each structure in /C which, in turn, contradicts property (IV). « 


Constructing an appropriate class of structures 


We proceed to construct a class of structures 1C which satisfies properties ([I]) - (IV I. Our 
approach is a generalisation of the well-known construction of Cai, Fiirer and Immerman [Jj 
for cyclic groups other than F 2 . To illustrate the main differences, let us briefly recall 
the idea of the original construction. Starting from an undirected and connected graph 
Q - (V, E), we take two copies eo, e\ of every edge e € E. Moreover, for every vertex v s V 
we consider the set vE £ E of edges which are adjacent to v and we add one of the following 
two constraints to restrict the symmetries of the resulting CFI-grapli: either the set of all 
sets {e p ( e ) : e € vE} with p : vE -*■ F 2 and Y,ezvE p( e ) = 0 is stabilised (an even node) or the 
dual set of all sets {e p ( e ) : e e vE } with p : vE -*■ F 2 and Y, e evE p( e ) = 1 is stabilised (an odd 
node). These constraints are encoded by a simple graph gadget. Although it seems that 
for each of these exponentially many choices we obtain a different CFI-graph, there really 
are, up to isomorphism, only two such graphs which in turn are determined by the parity of 
the number of odd nodes. Very roughly, the reason is that we can transpose, or twist , two 
copies eo,ei of each an edge e and move this twist along a path (in the connected graph Q) 
to iteratively resolve pairs of odd nodes. 

In order to generalise this construction to F 9 we take for every edge e € E a directed cycle 
of length q over q copies eo, ei,..., e g _i of the edge e. We then add similar constraints for 
sets of incident edges as above, but naturally, instead of having only two different kinds of 
such constraints, we have one for each value 0,1,...,? - 1 e F 9 . Now, instead of twisting 
pairs of edges, we consider cyclic shifts of length < q on the edge classes eo, e \,..., e q -\ which 
respect the cycle relation. Again, these shifts can be propagated along paths in the original 
graph Q and, with a reasoning analogous to the original approach, it turns out that there 
are, up to isomorphism, only q different types of generalised CFI-graphs over F g . We remark 
that the same kind of generalisations has been studied, for example, in [13 H^- 


Let us formalise the above described intuitions. We start with an (undirected), connected 
and ordered graph Q = (V,<,E). Let C,I and R be binary relation symbols. We set r := {< 

, C, /, R}. We define for every prime q and every sequence of gadget values d = (d v ) v ^v € [?] V 
a r-structure CFI g (C/, d) which we call a CFI-structure over Q. For the following construction 
we agree that arithmetic is modulo q so that we can drop the operator “mod q ” in statements 
of the form x = ymod q and x + y mod q for the sake of better readability. For what follows, 
let E(v) £ E denote the set of directed edges starting in v. Since Q is an undirected graph, 
this means that for each undirected edge {?;, u>) of Q we have ( v , w) € E(v) and (w, v) e E(w). 
The construction is illustrated in Figure |T] 
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h The universe of CFI q (Q,d) consists of edge nodes and equation nodes. 

. The set of edge nodes E is defined as E := (J e$E e where for every directed edge e 6 E 
we let the edge class e = {eo, ei,..., e q ^i} consist of q distinct copys of e. In particular, 
for every edge e = (v, w) e E and its reversed edge e _1 := / = (w, v) e E the sets e and 
/ are disjoint. We say that two such edges (or edge classes) are related. 

_ The set of equation nodes V is defined as V ■= U u6 y v d ( v l where for every vertex v € V 
and d 6 [g] the equation class v d consist of all functions p : E(v ) -»■ [q\ which satisfy 
XI P •“ SeeS(u) P(^) — ^■ 

b The linear preorder < orders the edge classes according to the linear order induced by 
< on E. More precisely, we let e < / whenever e < f. Similarly, < orders the equation 
classes according to the order of < on V, i.e. v < w if v < w. Moreover, we let e < v for 
edge classes e and equation classes v. 

_ The cycle relation C contains a directed cycle of length q on each of the edge classes e 
for e e E, i.e. C = {(ej,ei+i): i e [g],e e E}. 

b The inverse relation I connects two related edge classes by pairing additive inverses. 
More precisely, let e = (v,w) € E and / = (w,v) e E. Then I contains all edges (e x , f v ) 
with x + y = 0 for x, y 6 [g]. 

h The gadget relation R is defined as R := U u6 V R'!!"' 1 where for v 6 V and d € [q] the 
relation R d is given as 


8% : = {(Pi e p(e) ) : pe D d ,ee E(v)}. 



At first glance our construction associates to every graph Q (with the above properties) 
and to each sequence of gadget values d e [g]' a different structure CFI 9 (C/, d). However, for 
each graph Q with the above properties there really are, up to isomorphism, only q different 
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CFI-structures CFl q (Q,d). In fact, the value ffd := T.vzV d(v) completely determines the 
isomorphism class of a CFI-structure over Q. 

To obtain this characterisation, we analyse the automorphism group of CFI-structures 
and, more generally, the set of isomorphisms between two structures 21 = CFI g (C?,di) and 
03 = CFI 9 (t/,d 2 ). For such structures we know that the set E of edge nodes, the linear 
preorder < on E, the cycle relation C and the inverse relation / do not depend on the 
sequence of gadget values. This means that each possible isomorphism 7r which maps 21 to 
23 induces an automorphism of the common substructure £ := (E, (< ] E),C, I) which only 
depends on Q but not on d e [q] 1 . Thus 

(Iso(2l, 03) 1 E) £ T := Aut(£) < Sym(E). 

Let 7T € r. The linear preorder < on E and the cycle relation C enforce that 7r is the 
composition of cyclic shifts on the individual edge classes e, i.e. 7r e Y\ e <iE({ e o e v e q-i )) < 
Sym(E). It is convenient to identify the group Y\ e <iE({ e o e v e q-i )) with the vector space 

in the obvious way. 

In addition, the inverse relation I enforces that cyclic shifts for pairs of related edge 
classes are inverse to each other in the following sense: let e = ( v,w ) 6 E and / = (w,v) e E 
be a pair of related edges. Assume that we have a permutation 7r e such that 7r(e) = x 
and 7r(/) = y. We have (eo, /o) 6 I- Hence, if 7r is supposed to be an automorphism of £ then 
we have 7r(/) = I and thus ( e x , e y ) e I which means that x + y = 0. 

In conclusion, it follows that T < F^ is the subgroup of F^ which contains all .E-vectors 
7T e F^ with the property that 7r(e) + 7r(/) = 0 for pairs of related edges e, / 6 E. Again we 
remind the reader that T only depends on Q but not on d e [g] 1 . If we want to stress this 
dependence, then we sometimes write r(C?) but usually we omit Q if the graph is clear from 
the context. 

Now, given a CFI-structure 21 = CFI q (Q,d), we define for each vertex v € V the v-gadget 
as the set gadget (v) := v d ( v > to U e eE(v) e- 

► Lemma 9. Let 21 = CFI g (C/, d) and let 7r 6 T. Then there is precisely one extension n of n 
to Em V such that 7r(2l) is a CFI-structure over Q. 

Proof. Let p e v - f or some v eV. We show that under the assumption that 7r(2l) is a 
CFI-structure over Q the action of 7r on E determines 7r (p). 

We have that (p, e p ( e )) e R for all e € E(v). Hence for a potential isomorphism 7r we must 
have that (7r(p),7r(e p ( e ))) e R' (for a gadget relation R' of a CFI-structure over Q). Since 
we have 7r(e p ( e )) = e p ( e ) +7 r(e)! it follows by the definition of CFI-structures that the function 
7 r(p) : E(v) -> [g] is determined as (fr(p))(e) = p(e) + n(e) which in turn only depends on 
the action of ir on the edge classes e for e e E(v). < 

The preceding lemma shows that Iso(2l, 03) can be identified with a subset of T. In fact, 
the set Aut(2l) turns out to be a subgroup of T of which Iso(2l, 03) is a coset in F. Specifically, 
we saw that every 7r e T can uniquely be identified with an isomorphism of CFI-structures 
over Q by setting 7r(p) = p + 7r for p 6 v d . As a consequence, this means that n{v d ) = v d * 
where d* = d + T, e zE(v) n ( e ) an d that 

^{E- r ) — {(p + 7T, e p ( e ) +w ( e ) ) • (Pj ®p(e) ) 6 Ey } — E v . 

In particular, 7r stabilises the relation R d if, and only if, Y.ezE(v) n ( e ) = 0- 
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► Lemma 10. T acts on {CFI g (C7, d) : d e [g] 1 }. For n eT we have 
7r(CFI 9 (t/, d)) = CFI 9 (t/,d*) where d*(v) = (d(v) + ^ ^(e))- 

eeE(v) 


► Lemma 11. Let d,d* e ([g]) F be two sequences of gadget values. Then CFI g ((?,d) = 
CFI g (t/,d*) if, and only if, Y,d = £d*. 


Proof. Let n € T such that 7r(CFI g ((7,d)) = CFI g (t/,d*). By Lemma 
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this means that 


d*(v) = (d(v) + 'Z e sE(v) 7r(e)) for v 6 V. Thus T,vzV d*(v) = T, vsV d(v) + Z ue y T, e ^E(v) *(e) = 
T.vtvd(v) + Se6B 7r ( e )- Since for all pairs of related edges e, f € E we have 7r(e) + 7r(/) = 0 
the claim follows. 


For the other direction we proceed by induction on the number i of vertices v € V such 
that d(v) + d*{y). If no such vertex exists, then the claim is trivial. Otherwise, because of 
our assumption, there exist at least two such vertices v,w e V, v + w. Since Q is connected 
we find a simple path 


p : v = v 0 vi -E* v 2 - v m = w 


from v to w of length m > 1. Consider the following E- vector 7r e which is defined for 

x := d*(u) - d(v) as 


7r(e) 


z, if e= (vi,v i+1 ),0 < i < m 

■ -z, if e = (vi+i, Vi), 0 < i < m 

0, else. 


By the definition of tt it follows that 7r € T. Let 7r(CFI g (t/, d)) = CFI g (f7, d+). We claim that 
the number of v e V such that d+(v) d*(u) is at most i — 1. From Lemma 

d+(v) = d(v) + T,e£E(v) n ( e )- For v e V it follows that 


10 


we know that 


if v £ {uo,.. . ,v m }, then d+(v) = d(v), and 
b if v = vo, then d + (v) = d(v) + z = d*(u), and 
b if v - Vj for 1 < j < m, then 


d+(v) = d(v) + n(vj,Vj-i) + n(vj,Vj+i) = d(v) - z + z = d(v), and 


h if v = v m , then d+(v) = d(v) - z. 

Thus the claim follows from the induction hypothesis. < 


The kind of isomorphism that we constructed in the proof of Lemma [H]plays an important 
role later on. Thus, for a simple path p from vq to v m (m > 1) 


p : v = v 0 v iv 2 —> ^ v m = w 


as above and a constant z e F g we denote this isomorphism by 7r[p, z\ e T. In other words, if 
we let a z [e] e T for e 6 E and z e F g denote the FI-vector which is defined as 


e](/) = 


z, 

~z, 

0 , 


if / = e, 
if / = e"\ 
else, 


then ir\p,z\ = cr z [(v o,^i)] + cr z [(v 1 ,^ 2 )] + ••• + cr z [(v m -i,v rn )]. Intuitively, the isomorphism 
7 r [ p , z] allows us to simultaneously increase the gadget value at vq by 2 and to decrease the 
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gadget value at v m by z while the induced twists are moved along the path p through the 
gadget relations of the vertices Vj, 1 < j < to, whose gadget value does not change. A very 
important special case arises when p is a simple cycle of length to > 3 

p : v = v 0 Vi v 2 - ^*v m = v. 

Then for all values z e¥ q the isomorphism n[p, z\ e T is an automorphism of CFI-structures 
over Q. We are going to use these automorphisms to show that it is possible to define in 
FPC an ordering on the orbits of ^-tuples as required by property 0- It turns out that it 
therefore suffices to ensure that the graph Q is sufficiently connected. 

Recall that a graph Q is k-connected, for k > 1, if Q contains more than k vertices and if 
Q stays connected when we remove any set of at most k vertices. The connectivity con (Q) 
of a graph Q is the maximal k > 1 such that Q is fc-connected. Moreover, the connectivity 
con(©) of a class © of graphs is the function con(©) : N -*■ N defined by 

min con (Q). 

Gz®,\g\=n 

We are prepared to define the class 1C: let © be a class of undirected , ordered graphs such 
that con(©) e w(l). Then we set 

lC = IC q :={CFI q (g,d) : g = (V,<,E)e®,de[q] v }. 


Verifying the required properties 


We proceed to show that K. satisfies the required properties § - 

First of all, we saw that the automorphism group of each CFI-structure CFI 9 ((?,(i) is a 
F g -vector space, so property |T]) clearly holds for the class K.. 

The proof that K. satisfies property ([IT]) is more involved. Let us fix the length i > 1 of 
tuples on which we want to define a linear preorder which identifies Aoi-orbits. By the choice 
of YC it suffices to consider CFI-structures 21 = CFl q (g,d) over graphs g = (V,<,E) with 
con(£/) > (t + 2) since almost all structures in 1C satisfy this condition. As above let T < 
denote the group that acts on the set of CFI-structures over g and let A := (V ta E) denote 
the universe of the CFI-structure 21. 


► Definition 12. Let A < t and let a e A x . 


(i) Let v € V. We say that the vertex v is marked (given the parameters a) if for some 
x e {ai,... ,a>,} we have x e v (= v d( ' v ' ) ). 

(ii) Let e = ( v,w ) e E. We say that the edge e is marked (given the parameters a) if one 
of the vertices v or w is marked or if for some x 6 {ai,..., a^} we have that x e e u / 
where / = (w, v) e E is the edge related with e. 

► Lemma 13. Let X< £ and let a e A x . 

(a) If v eV is marked , then the v-gadget can be identified in Cf^ (using the parameters a), 
i.e. for every c egadgetfv) there exists a formula d(x,y) € C^ such that $ a (a) = {c}. 

(b) If an edge e e E is marked, then the edge classes e and f for f = e -1 are identified in C^ 2 
(given the parameters a), i.e. for every c e e tu / there exists a formula d{x,y) e C^ 2 
such that d' l (d) = {c}. 
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Proof. First of all, it is straightforward (even without using the parameters) to fix the <-class 
of any element c € A in Secondly, observe that if an element p e v is fixed, then we can 

fix an element in each of the edge classes e for e e E(v) since p is Abconnected to precisely 
one vertex in each of these classes. Moreover, if we have fixed an element x e e in some edge 
class e, then we can simply use the cycle relation C to identify each element c € e via its 
C-distance to a in C^ w . Finally, the inverse relation I yields a definable bijection between 
related edge classes. « 

► Lemma 14. Let A < £, a e A x and let v € V be a vertex that is not marked. Then for 
all edges e,e' e E(v), e t e' which are not marked there exists it 6 Aut(%, d) such that 
7r(e) = -Tr(e') + 0 and such that ir(f) = 0 for all f e E(v) \ {e,e'}. 

Proof. Let e = (v,w) and e! - ( v,w') as above. Then the vertices w and w' are not marked. 

Consider the graph Q' that results from Q by removing the vertex v and each marked 
vertex y 6 V. Let V' £ V denote the vertex set and E' £ E the edge relation of the graph Q'. 
Moreover, let M := {ai,..., a\} n (U e6 _E e). We observe that \V\ - \V'\ < A - \M\ + 1. 

For every x e M there is an edge / e E such that x € /. For each such edge / that is 
also contained in the subgraph Q' we delete one of its endpoints but neither the vertex w 
nor the vertex w' and denote the resulting subgraph by Q" with vertex set V" £ V' and 
edge relation E" Q E'. It still might happen that there is a parameter x e M such that 
x e / for / e E". However, this can only occur if / connects w' and w. Since we removed 
at most (|H| - |V|') + \M\ < A + 1 < (£ + 1) vertices from the graph Q to obtain Q" and since 
con(£?) > (t + 2) we know that there is a simple path of length m > 2 (i.e. the path does not 
consist of a single edge between w and w') which connects w and w' in Q": 

E" E" E" e" e" , 

p : w —* Vi —* v 2 -»-* V m -1 —» w . 

We extend p to a simple cycle p c in Q from v to v by using the edges (v,w), (v,w r ) e E: 

EE E EE E , E 

Pc : V -» W -» V 1 -» V2 -*-» V m -1 -> W -* V. 

Let 0 t z € [q\. We claim that n := 7r[p c , z\ satisfies the desired properties. 

By the definition of tt it holds that 7r(e) = z = -7r(e'). Let x e {ai,..., oa}- Then we 
have x i U™! 1 u w u w' u v, since none of the vertices v, w and w' is marked and since we 
removed any other marked vertex y €V from Q. 

Moreover, for / e {(a, w), (w, v ), (v, w'), ( w ', f)} we have that x if by our assumption 
that e,e' are not marked. Also for / e {(w,Vi), (w 'we have x i f since otherwise we 
had removed the vertices V\ and y m _i from Q'. Finally, for / e U™i 2 {(w f j+i), (uj+i,Uj)} we 
have x i f since otherwise we had removed one of the endpoints of each such edge / from Q'. 
Hence n(x) = x. Finally, since v i V" we also have that 7r(/) = / for all / i E(v) \ {e, e'}. < 

► Lemma 15. Let X<£ and let a,beA x . Then (21, a) =^ +2 (21,6) if, and only if, there exists 
7 t e Autf'Qi) such that n(d) = b. 

Proof. We proceed by induction on the maximal position 1 < i < A up to which the tuples a 
and b agree, i.e. such that for 1 < j < i we have aj = bj and such that ai + bi. Let a := a; and 
b := bi. Then we have to show that there exists an automorphism 7r e Aut(2l, a\ ■■■ai- 1 ) such 
that 7r (a) = b. Since a, and b have the same C^-type we know that a and b belong to the 
same <-class. We choose v e V such that a, b egadget(a). 

In what follows, whenever we speak of marked vertices or marked edges then we implicitly 
refer to a marking with respect to the already fixed part of parameters {ai,..., a^_i). 
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Without loss of generality we may assume that the vertex v is not marked (by an element 


x e {ai,...,cq_i}), because otherwise, by Lemma 13 every element in gadget(-y) can uniquely 
be identified in Cf^. We distinguish between the two cases where a and b are equation 
nodes and where a and b are edge nodes. 

For the first case let a, b e v. There exists a unique 7r 6 Wq^ such that 7r(a) = b and 
such that Y,etE(v) n ( e ) ~ 0- Moreover, this vector 7r can easily be defined in C;^ given 
the elements a and b. Now assume that one of the edges e = (v, w) € E(v) is marked but 
that 7r(e) ± 0. Si nce the edge e is marked, every element in e can uniquely be identified in 
However, since a and b are R-connected to different elements in e (as 


by Lemma 


13 


7r(e) * 0) this contradicts the fact that a and b have the same C^-type. Thus, for every 
edge e e E{v) we either have that 7r(e) = 0 or that e is not marked. By induction on the 
number of edges e € E(v) with 7r(e) + 0 we show that 7r can be extended to an automorphism 
in Aut(2l, ai,..., aj_i). Thus let us fix e € E{v) such that 7r(e) t= 0. Since we have that 


14 


T,fzE(v) tt(/) = 0 there has to be another edge e' € E(v) with 7r(e') t 0. We apply Lemma 
to obtain an automorphism a e Aut(2l, ai,..., aj_i) such that cr(e) = 7r(e), cr(e') = -7r(e) 
and cr(f) = 0 for all / e E(v) \ {e,e'}. Now consider (tt - a) e ¥q^ v \ By the induction 
hypothesis we can extend this vector to an automorphism 7r* e Aut(2l, a ±,..., cq_i). But 
then (-7T* + a) e Aut(2l, ai,..., Gq_i) is an extension of 7r. 

For the second case assume that o, b e e for some edge e € E(y). As above we conclude 
that the edge e is not marked. Since con(^) > (£ + 2) the minimal degree of each vertex in Q 
is at least (£ + 4). Since the vertex v is not marked there has to be another edge e! e E(v), 
e + e! which is not marked. Thus we can apply Lemma 14 to obtain an automorphism 
7r e Aut(2l, ..., Oi_i) such that 7r(a) = b and 7r(/) = 0 for all / e E(v) \ {e, e'}. < 


It is well-known that classes of C^-equivalent tuples can be ordered in FPC, see e.g. 
E]. Hence, it follows from our previous lemma that the class K, satisfies property @- 

► Lemma 16. The class K satisfies the properties |7]j and 10- 


Let us now turn our attention to property (IVI. In the next lemma we are going to 
show that for each k > 1 and each sufficiently connected graph Q 6 ©, the logic cannot 
distinguish between any pair of CFI-structures over Q (although there exist non-isomorphic 
CFI-structures over Q). 

► Lemma 17. Let k > 1 and let Q - (V,<,E) 6 0 such that con(Q) > k. Then for all 
d, d* s [g] 1 it holds that 

CFI q (g,2)=% CFI,(0,d*)- 

Thus, the class K, satisfies property 10- 

Proof. Let 21= CFl q (Q,d ) and let S = CFl q (Q,d *). Without loss of generality we assume 
that 21 £ f8. We show that Duplicator wins the /c-pebble bijection game on 21 and 23. Let 
z a := HvieV d{v), let Zb ■= T.vieV d*( y ) and let z := Zb - z a . As above, for e = (v,w) € E and 
y € [q] we let cr v [e] s T = T(t/) denote the isomorphism which shifts the edge class e by y, 
the edge class / for / = ( w , v) by -y and which stabilises all remaining classes, i.e. 


e](/) = 


2, if f=(v,w), 

~z, if / = (w,v), 
0, else. 
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Given a position (21, a \,..., ai, 03, t»i,..., be) in the /c-pebble bijection game, we say that a 
pair (v,tt) with v € V and 7 r e r(<7) is good if: 

h the ^-gadget is not marked (by the pebbled elements 01 ,..., ag in 21 or, equivalently, by 
the pebbled elements b \,..., bg in 03), 

b 77 ( 74 ) = bi for 1 <i < £, 

h 7 r(2l \ f)) = 03 \ u, and 

“ (<7 z [e] + 7r) (21 Igadget(Tj)) = 03 1 gadget^) for all e e E(v). 

Intuitively this means that 7 r is nearly an isomorphism between 21 and 03 except for 
gadget associated to vertex v. Of course 7r itself does not induce a bijection between 
universes of the two CFI-structures (as otherwise 21 = 03). However, for each e e E{y) we 
associate a bijection 7r e : A -*■ B to 7r which is defined as 

7 r(x), if x $ v, 

(cr 2 [e] + 7r)(a:), if x e v. 



the 

the 

can 


In what follows we show that Duplicator can play in such a way that after each round 
such a good pair (77,77) exists. Obviously, if Duplicator can maintain this invariant this 
suffices for her to win the game. 


Indeed we can find such a good pair (v,7r) by Lemma 11 for the initial position (21,03) 
of the game. Let us now consider one round of the game which starts from a position 
(21, ai, ..., ag, 03, 61, ..., bi) for which a good pair (77,7 r) exists. First, Spoiler chooses a pair 
i < k of pebbles which he removes from the game board (if the corresponding pebbles are 
placed at all). Duplicator then answers Spoiler’s challenge by providing a bijection 77 e for 
some edge e € E(v) which is not marked. Note that such an edge e exists since con(<7) > k 
and thus each vertex has degree at least k + 2. Spoiler picks a new pair (a, n e (a)) e A x B of 
7 r e -related elements on which he places the i-th pair of pebbles. By the properties of 77 it 
immediately follows that the resulting mapping a[i 1 -+ a] *-»• b[i >—>- 6 ] is a partial isomorphism. 
However, it might happen that Spoiler placed the i-th pair of pebbles on equation nodes 
v in the gadget associated to vertex v. In this case the pair (77,77) is not good any longer. 
So assume that Spoiler pebbled a new pair of elements ( a,w e (a)) € v x v. Since the edge 
e = (77,777) was not marked we know that w is not marked. Thus it is easy to see that the 
pair (777, <j z [e] + 7 r) is good. * 


To complete our proof we establish an FPS 9 -definable canonisation procedure on the 
class K.. The idea is as follows: given a CFI-structure 21 = CFI 9 (C/, d) over a graph Q and a 
value z € [g] we construct a linear equation system over F 9 which is solvable if, and only if, 
Y,d= z. This linear equation system is FO-definable in the structure 21 which shows that 
FPS g can determine the isomorphism class of a CFI-structure over Q. Since the graph Q is 
ordered it is easy to construct an ordered representative from each isomorphism classes of 
CFI-structures over Q which concludes our argument. 

More specifically, let Q = (V,<,E) e 0, let 21 = CFI 9 (t/,d) e K. and let z e F g . For our 
linear equation system we identify each element e E and each vertex v e V with a variable 
over Fq, i.e. we let V := E i+J V be the set of variables. The equations of the linear system are 
given as follows: 
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ej+i = d +1 for all € E (E 1) 

e* = -f-i for related edges e, / e E (E 2) 

v = ^ e p ( e ) for all v € U, p € v (E 3) 

eeE(v) 

z = £ v - ( E 4 ) 

veV 


It is easy to see that this system is FO-definable in 21. First of all, the equation (E 41 
can be defined as a sum over the ordered set V. Moreover, we can express the equations 
of type (E 1) and (E 2 1 by using the cycle and inverse relation, respectively. Finally, the 
equations of type (E 31 can be expressed by using the gadget relation R. 

► Lemma 18. The above defined system is solvable if, and only if, Yd = z. 


Proof. If Y,d = z then it is easy to verify that we obtain a solution a e of the linear 
system by setting d(ei) = i and <r(v) = d(v). For the other direction, we show that a solution 
? 6 Fj 1 of this system defines an isomorphism n between 21 and 18 = CFI 9 (C/,d + ) where 
d+(v) := <y(v). As a preparation, we let S(e ) := d(ei) - i for e e E and some € e. Since a is 
a solution, S e is well-defined. Now we obtain the isomorphism n for ei € E and p € V by 
setting 


7T( e i) ^ e CT ( ei ) 
7 r(p) h* p + S. 


Using the equations (Ell and (E 2 I one easily verifies that 7 r respects the cycle relation C 
and the inverse relation /. Moreover, let (p, e p ( e )) 6 -R- Then 


K(.e P (e)) = e a( ep(E )) and d ( e p(e)) = P( e ) + ^( e )- 


Thus, 7 r also respects R. Finally, by the equations of type (E 31, for all v e V and p € v we 
have that 


Ep + (5= Z d ( e p(e)) = d (^)- 

eeE(v) 


This shows that d(v ) = d+(v) and that Y, d+ = Zt, 6 y d(v) = 0 because of equation (E 4l. 


Lemma 19. The class K, satisfies the property (III). 
This finishes our proof of Theorem [3] 


4 Solvability quantifiers vs. rank operators 

In the previous section we obtained separation results for the extensions of FPC by solvability 
quantifiers (and rank operators) over different sets of primes. One important step of our proof 
was to construct a class of structures on which the expressive power of the logics FPRq and 
FPSn coincides. Moreover, as we already mentioned in Section [2] most of the queries which 
are known to separate fixed-point logic with counting and rank logic can also be expressed 
in FPS. This leads to the interesting question whether, in general, rank operators can be 
simulated by solvability quantifiers within fixed-point logic with counting. In this context, it 
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is worthwhile to remark that many other problems from linear algebra are known to sit in 
between of “solving linear equation systems” and “computing the matrix rank”, for example, 
deciding whether two matrices are similar or equivalent, see ps urn nil . 

In this section we solve a simplified version of this question and show that in the absence 
of fixed-points and, more importantly, in the absence of counting, rank operators are strictly 
more expressive than solvability quantifiers. The reader should note that rank operators can 
easily simulate counting terms but this does not hold for solvability quantifiers. 

In order to state our main result formally, we first define for every prime p the extension 
FOSp of first-order logic (without counting) by solvability quantifiers over F p . The crucial 
difference to the extension FOR p of first-order logic by rank operators rk p is that the logic 
FOSp is a one-sorted logic which does not have access to a counting sort. 

► Definition 20. For every prime p , the logic FOS p results by extending the syntax of FO 
by the following formula creation rule: 

h If ip(x, y,z) e FOSp, then = (slv p x, y)(p(x, y, z) is an FOSp-formula. 

The semantics of ip(z) are defined as above. For completeness, let k = |i| and £ = |y|. A pair 
(21, z c) with c e defines an I x J-matrix over {0,1} £ F p where I = A k and J = A 1 
and where M v (a, b) = 1 if, and only if, 211= <p(d, b, c ). 

Let 1 be the /-identity vector over F p , i.e. 1(a) = 1 for all del. Then M v and 1 
determine the linear equation system M v • x = 1 over F p . Now we let 211 = ip(c) if, and only if, 
Afp • x = 1 is solvable. 

Analogously to the definition of FPS in Section [2] the syntactic normal form of definable 
linear equation systems in the definition of slvp-quantifier does not lead to a severe restriction 
(again, see Lemma 4.1 in [B|). 

Let us briefly summarise what is known about the logic FOS p (see also [S}|TH]). First 
of all, it follows from [7] that for every prime p , the logic FOS p can express the symmetric 
transitive closure of definable relations. Hence, FOS p subsumes the logic STC and can 
express every LOGSPACE-computable property of ordered structures. Secondly, it also follows 
from [7] that FOS 2 can distinguish between the odd and even version of a CFI-graph, 
which means that FOS 2 cannot be a fragment of FPC. More generally, by adapting the 
CFI-construction for other fields one can show that FOS p ^ FPC for all p s P (see e.g. USD- 

On the domain of ordered structures, the expressive power of FOSp can be characterised 
in terms of a natural complexity class: in [5], Buntrock et. al. introduced the logarithmic 
space modulo counting classes MOD^L for integers k> 2. Analogously to the case of modulo 
counting classes for polynomial time, the idea is to say that a problem is in MOD^L if there 
exists a non-deterministic logspace Turing machine which verifies its inputs by producing a 
number of accepting paths which is not congruent 0 mod k. For the formal definition we 
refer the reader to [3]• It turns out that, at least for primes p , the class MOD p L is closed 
under many natural operations, including all Boolean operations and even logspace Turing 
reductions mm- Furthermore, many problems from linear algebra over F p are complete 
for MODpL. In particular this is true for the solvability problem of linear equation systems 
over Fp and for computing the matrix rank over F p [5]. 

Building on these insights, Dawar et. al. were able to show that for all primes p, the logic 
FORp captures MOD p L on the class of ordered structures. It has been noted in m that 
their proof shows that the same correspondence holds for the logic FOS p . 

► Proposition 21 (|7].p8]). On ordered structures we have FOSp = FOR p = MOD p L. 
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Despite this characterisation over the class of ordered structures, the situation over general 
structures remained unclear. It easily follows that FOS p < FOR p < FPR, but, so far, it has 
been open whether one, or even both, of these inclusions are strict. In this section we are 
going to settle one of these questions: 


► Theorem 22. For all primes p we have FOS p < FOR p (over the class of sets S( 0 )). 


In some sense, this result is not very surprising. Over the class of sets, the logic FOR p 
captures the complexity class MOD p L since the size of a set is a complete invariant. In 
contrast, the logic FOS p cannot access the counting sort and thus had to express properties 
over pure unordered sets which have the maximal amount of symmetries. However, it is 
not obvious how one can turn this intuition into a formal argument. Strikingly, FOS p has 
non-trivial expressive power over sets. For instance, FOS p can determine the size of sets 
modulo p PE and consequently, modulo p k for every fixed k (since n = 0 mod p k if, and 
only if, n = 0 mod p and Q) = 0 mod p fc_1 ). Note that fixed-point logic FP, for example, 
collapses to first-order logic over sets. 


In order to prove Theorem 22 we make use of the following strong normal form for FOS, 


which has been established in Corollary 4.8 of |jj . 


► Theorem 23. Every formula 1 9(z) € FOS p is equivalent to an FOS p -formula of the form 
(slv p xi,X 2 )a(xi,X 2 ,z) where a(xi,X 2 ,z) is quantifier-free. 


Similar to our approach in Section [3] the main idea for separating FOS p and FOR p 
is to exploit the symmetries of definable linear equation systems. More precisely, we are 
aiming at considerably reducing the size of an input linear equation system via an FOR p - 
definable transformation. For the remainder of this proof, let us fix a quantifier-free formula 
a(x\, ..., Xk, 3 /i,..., ye) e FO( 0 ) and a prime p. According to the semantics of FOS p , the 
formula a defines in an input structure 21 = ([n]) of size n the [n] fc x [//^-coefficient matrix 
M n which is given for a e [n] k ,b s [n] £ as 


M n (a, b) 


1 , if 211 = a(a, b) 
0 , otherwise. 


Then 21 1 = (slv p x±, X 2 )a(xi, X 2 ) if the linear equation system M n ■ x = 1 over F p is solvable. 
For convenience we set I n = [/?.] fe and J n = [n] f . 

Let T = T n = Sym([n]). Then the group T acts on I n and J n in the natural way. As in 
Section [3] we identify the action of 7 r e T with the multiplication by the associated I n x I n - 
permutation matrix n/ and the J n x J„-permutation matrix nj, respectively. Hence, for 
7 t e T we have 


Ui-M n - n/ = M n o Hi ■ M n = M n -Hj. 

For what follows, we fix a prime q which is distinct from p and a subgroup A < T which 
is a g-group, i.e. |A| = q m for some m > 0. The overall strategy is to use the A-symmetries of 
the matrix M n to strongly reduce the size of the linear equation system M n ■ x = 1. More 
precisely we claim that for M* := 11/ ■ M n the linear equation system M n ■ x = 1 is 

solvable if, and only if, M* ■ x = 1 is solvable. First of all we note that for all 7r e A we have: 

■ nj • M* = EaeA H/ • A/ • M n = EtteA H/ • M n = M* 

■ m* ■ n j = y.\za ^/ • M n ■ n j = y. a<ea A/ • n/ • M n = m*. 
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To verify our original claim assume that M* -6=1. Then we have 
l = M„*.6 =(^n 7 -M n )-S=(^ M n -Uj)-b = M n - £(n. 7 .&). 

7reA 7reA 7TG A 

For the other direction let M n -6=1. Then YneA 11/ • M n -b= |A| • 1, hence (1/|A|) -b is a 
solution of the linear equation system Mf -5 = 1. Note that for this direction we require that 
q and p are co-prime as we have to divide by |A|. 

Since M* satisfies 11/ • M* = M* ■ 11/ = M* for all n e A we have 

M*(a,b) = M*(n(a),b) = M*(a,n(b)) 

for all a e /„,& 6 J„ and 7r e A. In other words, the entries of the I n x J n -matrix M* are 
constant on the A-orbits of the index sets I n and J n . More specifically, if we let and J^ 
denote the sets of A-orbits on I n and J n , respectively, then M* can be identified with the 
matrix (M*/ A) which is defined as 

«/A): C x Jn - F p , ([a], [b]) ~ M*(a,6). 

Note that, depending on the size of the group A, the sets and J^ can be noticeably 
smaller than the index sets I n and J n . Hence our obvious strategy is to choose A as large as 
possible to obtain a much more compact linear equation system M* -x = \ which is equivalent 
to the given one. 

Recall that the maximal g-subgroups A < T are the q-Sylow groups of T. It is well- 
known that for the case where T = Sym([n]) these groups can be obtained via an inductive 
construction which we want to explain here for the special case of n being a power of q (the 
general case can be handled similarly, see e.g. m)- Hence from now on, let us assume that 
n = q r for some r > 1. 

First of all, we determine the size of g-Sylow groups of F. A simple induction shows that 
the maximal t > 1 such that q t divides n! = (g r )! is given as 

, r-1 r —2 , q r - 1 

t — q + q + ••• + g + 1 - -. 

g -1 

In fact, we can write (g r )! as (g r )! = 1--(1 • g)---(2 • g)---(g r_1 • g). Hence t = t*+ g r_1 where f* 
is the maximal such that g 4 * divides (g r_1 )!. 

In particular, if we denote for n = q r a g-Sylow of Sym([n]) by A r , then our argument 
from above shows that | A 11 = q and that 

|A r+1 | = |A r | 9 • q. 


As it turns out, this equation already gives a hint about the algebraic structure of A r . 
Indeed, A r+ i can be obtained as the wreath product of A r and the cyclic group F g . Since 
A/ = Fq it follows that A r is the ?'-fold wreath product of the cyclic group ¥ q . We decided to 
skip the formal definition of the notion of wreath products and rather to directly illustrate 
this concept for the particular case of the g-Sylow groups of T = Sym([n]) = Sym([g r ]). 

To obtain an algebraic description of these groups, we inductively construct for r > 1 
a g-Sylow subgroup A. r < Sym([g r ]) together with a family of trees T- r ' for i = 0 ,. .. ,r and 
x e [g r_l ] such that the following properties hold. 

(I) T.i is a complete g-ary tree of height i whose leaves are labelled with elements from [n]. 
More precisely, the labels of the leaves of T* form the set Vf = {x-q\ ..., (a; + l)-g l -l) 
(note that Vf is the rr-tli block of the natural partition of [n] into parts of size q l ). 
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(II) For all * < r the group A r transitively acts on the set {Tf : x e [q r ~ 1 ]} by applying 
permutations S e A r to the labels of the leaves of the tress 7”' T . Moreover, for each 
i < r, the subgroup of A r which point-wise stabilises the trees Vf is a normal subgroup 
of A r . 

(Ill) We have Ai < A 2 < ••• < A r where A* acts on the set of labels Vf of the tree 7~°. 
More generally, for every block Vf, the group A r contains a subgroup Af x < A r 
which point-wise fixes the elements of all blocks Vf for y t x and whose action on Vf 
corresponds to the action of A t on Vf. 

The inductive construction of the trees Tf is depicted in Figure [2] To understand this 
construction better, it is quite useful to think of elements y e [n] as being represented in 
their g-adic encoding, i.e. y = yo + y\ ■ q + ••• + y r _i ■ q r ~ 1 . Then we have that y e Vf = [n] and 

- y e Vfrf 

- y ev y r r 2 2+Vr - i q 

- y € = Vf. 

Hence, the g-adic encoding of y describes the unique path in the tree Tf from the root to 
the leaf Iff. The trees Tf clearly satisfy the properties stated in 0. 

For the inductive construction of the g-Sylow groups A r we first fix Ai as the cyclic 
group generated by the natural cyclic shift 7 = (01 ••• q - 1 ) on the set Vf = { 0 ,...,g-l}. 



Figure 2 Inductive definition of the trees Vf 

We proceed with the inductive step r « r + 1. The set [g ] r+1 splits into q blocks 
Vf,... ,Vf~ x each of size q r . The group A r acts on Vf and point-wise fixes the elements 
from the blocks Vf with x±0. Let 7 € Sym([n]) for n = q r+1 be the following permutation 
which shifts the segments Vf,... tVf^ 1 in a cycle of length q by composing the natural shifts 
on the sets of residues modulo q r : 

7 = (0••• (g - l)g r )(l ••• 1 + (q- l)q r )---(q r - l--q r -1 + (q- l)q r ). 

Hence for all a e [n] we have 7 (a) = (a + q r ) mod q r+1 . We set Af = A r and, more 
generally, Af = (y x )A r ( 7 x ) -1 for x = 0,..., q-1 to obtain q copys of A r which independently 
act on the segments Vf for 0 < x < q - 1. Finally, we define A r+ i as the semi-direct product 
of (A° x ••• x AfT 1 ) and the cyclic group ( 7 } of size q. This means that the group elements of 
A r+1 are elements in the set (Af x ••• x AJT 1 x ( 7 )) and that the group operation is given by 

(<5i,..., 5 q -\, a) ■ (ei, ..., e q -i,/3) = (c>i • ae\a 1 ,..., 5 q -\ ■ ae 9 -i a 1 , a ■ (3). 

Since |A r+ i| = |A | 9 • q we conclude that A r+ i indeed is a g-Sylow subgroup. 
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From our construction it immediately follows that A r+ i satisfies the properties stated 
in (III|. To see that A r+ i also satisfies the properties stated in @ we start by showing 
that, for i < r, A r+ i transitively acts on { Tf r : x e [(? T ’ +1_i ]}. If we split the set [g T ’ +1_i ] into 
q blocks ■p r 0 _ i ,... ,V?:l of size q r ~' L then we know from the induction hypothesis that A° 
transitively acts on the set of trees {T x ■ x € = {T x ■ x 6 [<z r ’~ 1 ]}- Moreover, it is easy 

to verify that for all x € [< 2 ,I ’ +1 ~*] we have j(7' x ) = T~ where z = x + q r ~ l mod q r+1 ~ l . Hence 
( j y ){Tj X ■ x e = { T x ■ x e for all 0 < y < q - 1 which means that AJ! transitively 
acts on {T x ■ x e RW} and thus © holds. 


The crucial step is to understand the action of A r on the sets I n = \n\ k and J n = [n] f 
(for the case where n = q r ). In fact, our next aim is to develop a complete invariant for the 
A r -orbits on these index sets. Recall that the sets of A r -orbits on I n and J n provide index 
sets for the succinct linear equation system M* ■ x = 1. To define this invariant, the main 
idea is to describe the position of a tuple a e /„ (or a e J n , respectively) in the tree T := "7J 0 . 

Let us first define the signature sgn (a,b) of a pair (a, b) e [n] x [n] as the tuple ( i,z ) € 
[r + 1] x [gr] such that the lowest common ancestor of a, b in T is the root of a tree T x and 
such that a is located in a subtree T^ Va for y a € [gr] and b is located in the subtree T* q 1 +Vb 
where yb = y a + z mod q. For the special case where * = 0we have a = b and agree to set 2 = 0. 
With this preparation we define the signature sgn(a) of a tuple a = (ai,... ,at) e J n as the 
list a e ([r + 1 ] x [g ])^ -1 ^ 2 consisting of the individual signatures sgn(a,;,aj ) for all pairs 
ai, aj with 1 < i < j < i. The signature of tuples in I n is defined analogously. 

► Lemma 24. Let a € J n . Then sgn(a ) = sgn^a) for all ir € A r . 

Proof. Immediately follows from the construction of A r and the trees T x . ■* 

► Lemma 25. Let a,be J n . If sgn(a) = sgn(b), then be A r (a). 


Proof. We proceed by induction on the maximal position 0 < i < t such that aj = bj for all 
j = 1,..., i. The case i - I is clear, so assume that i < I. Let a = (ai,. .., ai, dj+i, ..., at) 
and b = (ai,..., flj, &j+i,..., bf). We show that there exists a permutation S e A r which 
pointwise fixes a \,..., ai and such that <5(ai+i) = bi+\. Then the claim follows from Lemma 24 


together with the induction hypothesis. For i = 0 this is easy, because A r acts transitively 
on [n]. If i > 0 we choose a w e {ai,...,ai} such that sgn(a,„,aj + i) = (c, d) and such that 
c is minimal with this property. Obviously we have c > 0. By the choice of a w the lowest 
common ancestor of a w and di+i is the root of a tree T x . Moreover, a w is located in a 
subtree for some 0 < y < q - 1 and ai+i is located in the subtree 7(.^ + " where z = y + d 

mod q. Since sgn(a) = sgn(&) also bi +1 occurs as the label of a leave in the subtree Tff_X z ■ 
By the minimality assumption on c we know that non of the elements {ai,..., a^} occurs 
in the tree Hence, by the properties of the group A r stated in (III I we can find an 

element S e A r which point-wise fixes all elements outside the block Vf\ z (in particular, the 
elements a\,..., af) and which moves cq + i to b i+ 1 . < 


Following our definition from above, the signature sgn(a) of an element a e J n is a tuple 
of length £(£ - l)/2 whose entries are pairs (i,z) e [r + 1] x [g]. We denote the set of all 
possible sequences of this form by S.* = ([r + 1 ] x [q])^ 1 ^ 1 ^ 2 . Of course, not every tuple in 
<j e can be realised as the signature sgn(o) = a of an element a e J n . Similarly, we define 
the set S k = ([r + 1 ] x [g 1 ]) fe C fe_1 )/ 2 to capture all possible signatures of elements in I n . 

Since the coefficient matrix M* of the equivalent linear equation system M* ■ x = 1 can 
be defined as a matrix whose index sets are the collections of A r -orbits on I n and J n , we 
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can use the notion of signatures to describe M* as an (5* x S'^)-matrix. This fits with our 
proof plan as the index sets and S!) of the matrix M* are much smaller than the index 
sets I n and J n of the coefficient matrix M n of the original linear equation system. However, 
it still might be the case that the succinctness of the matrix M* does not help, because it is 
not possible to obtain its entries within FOR p . 

We show that this is not the case. More precisely we show that we can define the matrix 
M* in FOC in a structure of size r (where we assume that r > q). Therefore, the main 
technical step is to show that FOC can count (modulo p ) the number of realisations of a 
potential signature er e S*. 

First of all, we need some further notation. A complete equality type in k + £ variables 
is a consistent set t(x x , ..., Xk, Xk+i, ■ • ■, Xk+e) of literals Xi = Xj, Xi + Xj which contains for 
every pair i < j either the atom Xi = Xj or the literal Xi + Xj. Note that each quantifier-free 
formula a 6 FO(0) can be expressed as a Boolean combination of complete equality types. 

In the following main technical lemma we show that in the structure 21 = ([r]) we can 
count (modulo p) the number of realisations of a (potential) signature a € S„ in a subtree 
77 in FOC. More generally, this is possible if we additionally fix some entries of the tuples 
which should realise er in T?. Here we need another prerequisite: as we want to work with 
elements from the set [n] = [g r ] in a structure of size r we have to agree on some sort of 
succinct representation. Of course the natural choice here is to represent numbers x e [n] 
in the structure 21 via their g-adic encoding: a binary relation R £ [r] 2 which corresponds 
to a function R : [r] -»■ [g] represents the number x(R) € [n] = 7?(*) • q l ■ Note that this 

encoding requires a linear order on the set [r] (which is not the case for the structure 21). 
However, as we are working with FOC we can just use the number sort on which a linear 
order is available. Hence in the following, whenever we specify FOC-formulas or FOC-terms 
with free variables or with free relation symbols which should represent numbers, then we 
implicitly assume that these variables are numeric variables and that the relation symbols 
are evaluated over the number sort. The same holds for signatures a e S l n which we specify 
in FOC-formulas by a list of pairs (hi,di) of numeric variables of length ()). 

Before we state our main technical lemma it is helpful to recall that our inductive 
construction of the trees T* fits very well with the g-adic encoding of numbers x € [n]. Again, 
let x e [n] be given by its g-adic encoding as x - (xq, ■ ■ ■ ,x r -i) e [g] r , he. x = ZTq 1 Xi ■ q l . 
Then the i-th node on the unique path from the root in the tree T = T x to the leave Tq is 
the root of the tree Tf), where y - x r -i + x r -i+iq + ••• + Xr-iq 1 ^ 1 . In other words, the g-adic 
encoding of x precisely describes the path in the tree T from the root to the leave labelled 
with x where at level (r - i) the i last entries x r ... ,x r -i in the g-adic encoding of x are 
determined (i.e. a; is a member of the block 

► Lemma 26. For all £ >1 and 0 < s < £ there exist 

(a) a term Q(i,hi,d\,... ,h t ,dt) e FOCdl?^, Ri ,..., R s }), and 

(b) formulas (p e (y,z,i,h i,d 1 ,...,h t ,d t ) e FOC({R x , R ± ,.. .,R S }) for e = s + !,...,£, 
where t= ), such that for all r > q, all i < r, all o = ((hi, d ±),..., (ht,dt)) e Swhere n- q r , 
all x € [g r_i ] and all a\,... ,a s € Vf the following holds: let 21 = ([r]) and let R X ,R \,..., R s 
be numerical relations such that R x represents the (q-adic encoding of the) element x e [g’ *] 
and such that each Ri represents the (q-adic encoding of) the element ai. Then we have that 

(i) the value & 2[ (q, i,h\,d\,..., h t ,d t ) of the term 0 in 21 is \Z\ mod p where 
Z = {(a s+ i,... ,ae) e (Vf) l ~ s : sgn(a x ,... ,a s ,a s+x ,.. .,a e ) = o}. 
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(ii) if Z + 0, then the formulas ( (pe)s<e<t define the q-adic representation of witnessing 
elements a s+ \,..., at e Vf, i.e. such that (a s+ i,..., ai) € Z. 

Proof. First of all, by our previous observations it is easy to see that the condition aj s Vf 
for j = 1,..., s can be defined in FOC. More generally, we can use the q-adic encoding of 
the elements aj to determine sgn(ai,... ,a s ) in FOC. Hence, for the remainder of the proof 
we assume that sgn(ai,..., a s ) is consistent with a and that aj € Vf for j = 1,..., s. 

We proceed by induction on £. For £ = 1 it suffices to show that FOC can compute 
(n mod p ) where n = q r in the structure 21. To see this, recall that p and q are co-prime and 
thus we can use Lagrange’s theorem to conclude that q r = q r mod p if r' = r mod (p - 1). 
Since p is a constant, the claim follows. 

Let £ > 2. We distinguish between the following two cases. If s = 0, then we can partition 
the set of realisations a of a according to first entry ai into \V'f\ parts of equal size. It suffices 
to determine the size of each of these blocks, since we can determine \Pf\ mod p in FOC 
similarly as above. 

Without loss of generality let us assume that ai = x ■ q l . Since we have given the q -adic 
encoding of x it is easy to see that we can define the q-adic encoding of xq l in FOC. This 
gives us the formula <p\. Next, we partition the set of indices {2, ...,£} into classes according 
to the equivalence relation j\ & ja if cr(l,ii) = er(l, j-f). Let the resulting classes be Y\,... ,Y V 
and let cr(l, y ) = ( h w ,d w ) for all y e Y w and w = 1,... ,v. 

We observe that there exists a tuple a with di = x ■ q l which realises o in the tree Tf 
(that is Z + 0) if, and only if, the following conditions are satisfied: 


h for all w = 1,..., v we have h w < i , and 

h for every Y w = {yf,... ,yf w } there is a tuple a w of length i w which realises a (restricted 

to the indices from Y w ) in the subtree T^ q _ 1 +dw , and 
b for all pairs y\ e Y Wl and yi e Y W2 with w\ + W 2 we have that 


°(y 1 , 2 / 2 ) 


(h w 1, 
{hw^i 
(hwi > 


d W2 - d Wl mod q), 

if h w 1 — h W 2 

dw 2 ) 

if h w ^ < h w 2 

dwi ) 

6 

to 

A 

s 


Since £ is a constant, the number of possible partitions of {2, ...,£} is bounded by a 
constant as well. It is easy to see that for every possible such partition we can check the first 
and third condition in FOC. To verify the second condition in FOC we use the induction 
hypothesis. There are two aspects which have to be discussed with more precision. First of 
all, we have to handle one particular case separately: indeed, if h w = 1 for all w = 1,... ,v, 
then we cannot use the induction hypothesis since all elements (including ai) have to be 
chosen in the same subtree of height one. However, in this case there is only one realisation 
(if the third condition is satisfied) so this does not cause any problems. The other difficulty 
is that we have to define the g-adic encoding of the value z w = X q z ~ hw+1 + d w in FOC. We 
already noted before that the q-adic representation of xq l ~ hw+1 can be defined in FOC and 
since 0 < d w < q we can also define the q-adic encoding of 2 in FOC. 

In fact, the induction hypothesis also provides us with a term which counts modulo p 
the number of possible realisations of cr in the subtrees restricted to the indices in 

Y w together with formulas p e which define witnessing elements. Finally, since the overall 
number of possible realisations of o in 7 is the product of the realisations restricted to the 
components Y w , the claim follows for the case where s = 0. 

For the general case let £ > s > 0 and let ai,... ,a s e Vf be the components of the 
tuple a that are already fixed. Recall that we can assume without loss of generality that 
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sgn(ai, ... ,a s ) is consistent with a and that all elements a\, ..., a s are located in the subtree 
T*■ Since we have fixed the element a±, we can proceed as above except for two small changes. 
First of all, when applying the induction hypothesis we have to respect the remaining fixed 
elements 02 ,, a s . Moreover, when we form the partitions of {2, ...,£} into parts Y \,..., Y v 
as above then we have to adapt the position of elements corresponding to the index set Y w 

i-h w +1 

since the element ai is not necessarily contained in the tree T(( q +1 . However, since we 

have given the g-adic representation of ai we can define in FOC the element 0 < d a < q such 
that a\ is located in the subtree Tf( q +1 +d “. The remaining steps can be performed as 
above. This finishes our proof. « 

► Lemma 27. Let t(x\, ... ,Xk,yi, ■ ■ ■, ye) e FO(0) be a complete equality type (in k + £ 
variables). Then there is an FOC -term O T (z x ,z y ) such that for all r>q, all cr^ e S^ and 
<jg € S^, where n = q r , the value 0 a (<Ta,crg) of O in 21 = ([?’]) is 

0 2 '(g,CTa,(Jb) = | {be J n : sgn(b ) = erg, ([n]) t= r(d,6)}| mod p 


for some (or, equivalently, all) a e I n with sgn(a) = cr 5 


Proof. By Lemma |26| we can first check in FOC that a a and erg can be realised (otherwise 
the answer is trivial). Moreover, if r (restricted to x \,..., Xk) is not consistent with a a or if 
r (restricted to y 1 ,... ,yi) contradicts <jg, then the answer is trivial as well. 

In all other cases, Lemma [26] provides FOC-formulas which define in the structure 21 the 
g-adic encoding of elements a \,..., ak 6 [n] such that sgn(d) = Moreover, if r contains 
a literal Xi = yj , then we can fix the entry bj as well. Hence, let us assume without loss of 
generality that r contains the literals Xi t yj for all 1 < * < fc and 1 < j < i. 

For Y £ {1,... ,£} and a partial assignment e : {I ,...,(.} -* {ai,... ,afc) with dom(e) nF = 
0 we define the set 


By = {b e J„ : sgn(6) = <7g, for i e dom(e) : = e(i), for i eY : bi + ai,... , 0 *,}. 


With this notation our overall aim is to determine (\By \ mod p ) for Y = |T] in FOC. 
The first observation is that by Lemma 26 we can determine (|H|,| mod p) for all par¬ 
tial assignments e in FOC. The second observation is that we can construct the values 
(\By\ mod p) by induction on |F| as follows. For Y £ {1,.. .,£} and a partial assignment e 
(with dom(e) n Y = 0 ) we have for all j e Y that 


\B e y\~ 


I 

CL^{(1± 5 ■ • • } 


I B 


eu{jH*o}| 

Y\{j} I’ 


In this way we recursively obtain the value (\By\ mod p) for Y = [f\. Since £ is a constant 
the recursion depth is bounded by a constant as well and the procedure can be formalised in 


FOC. 


► Lemma 28. There exists an FOC -term 0(/r,^) which defines for all r > q in the structure 
21 = ([r]) the matrix M* where n = q r . 

Proof. Recall that we can view M* as an (S% x S'„)-matrix over F p . To represent the index 
sets S!f and Sf) we let (l and v be tuples of numeric variables of lengths |/2| = (*) and \v\ - (.^), 
respectively. 

Note that the entry M* {a a, erg) of M* for a a 6 S!( and erg e S ^ is given as 
M*(tJa,crg) = I {be J n : sgn(6) = crg,M„(d,6) = 1| mod p, 
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for some (or, equivalently, all) a e I n with sgn(a) = a d . The entry M n (a,b), in turn, 
is determined by the quantifier-free formula ct(xi,X 2 ) e FO(0). With this preparation, 


Lemma 27 already shows that we can determine the value a^) for the case where a 

is a complete equality type. For the general case we just write a as the union of complete 
equality types and combine the constant number of intermediate results. ■« 

► Definition 29. Let K. £ S(0) be a class of sets. The q-power K. q £ S(0) of K. consists of all 
sets 21 = ([<?' ]) such that 23 = ([r]) e /C. 

► Theorem 30. Let K, £ S(0) be a class of sets. If K q is definable in FOS p , then K. is 
definable in FOR p . 


Proof. If IC q is definable in FOS p , then by Theorem 23 we can also find a formula ip = 


(s\\/pXi,X 2 )a(xi,X 2 ) e FOS p that defines lC q such that a is quantifier-free. 

By using the above construction and Lemma |28[ we conclude that the linear equation 
system M n ■ x = 1 defined by a in an input structure 21 = ([n]) of size n - q r can be 
transformed into the equivalent system M* ■ x - 1 which is FOC-definable in 23 = ([r]). Let 
p* e FOR p be a formula which expresses the solvability of the linear system M* ■ x = 1 in a 
structure 23 = ([r]). 

Then 23 1= <p* if, and only if, 21 1= <p since the linear equation systems M n ■ x = 1 and 
M* ■ x - 1 are equivalent. * 

* Theorem 31. For all primes p we have FOS p < FOR p (even over §(0)/ 

Proof. Otherwise we had FOS p = FOR p . As above we fix some prime q + p. Let K. £ §( 0 ) 
be a class of sets such that K, £ FOR p , but such that ( K. q ) q e FOR p . Such a class K, is well- 
known to exist (just combine the fact that, over sets, we have Logspace < FOR p < Ptime 
and the space-hierarchy theorem, see e.g. PI)- Since FOS p = FOR p we had (lC q ) q e FOS p 
and by Theorem 30 this means that K q e FOR p . Again, since FOR p = FOS p , we had 
K q 6 FOS p . A second application of Theorem 30 yields K. e FOR p which contradicts our 
assumptions. * 


Finally we remark that the proof also works for the extension of fixed-point logic by 
solvability quantifiers but in the absence of counting. The simple reason is that fixed-point 
operators do not increase the expressive power of first-order logic over the empty signature 
since all definable relations are composed from a constant-sized set of basic building blocks. 


5 Discussion 

We showed that the expressive power of rank operators over different prime fields is incom¬ 
parable and we inferred that the version of rank logic FPR with a distinct rank operator rk p 
for every prime p € P fails to capture polynomial time. In particular our proof shows that 
FPR cannot express the uniform version of the matrix rank problem where the prime p is 
part of the input. Moreover, we separated rank operators and solvability quantifiers in the 
absence of counting. 

Of course, an immediate question is whether the extension FPR* of FPC by the uniform 
rank operator rk* suffices to capture polynomial time. We do not believe that this is the 
case. A natural candidate to separate FPR* from Ptime is the solvability problem for linear 
equation systems over finite rings rather than fields [5]. While linear equations systems 
can be efficiently solved also over rings, there is no notion of matrix rank that seems to be 
helpful for this purpose. In particular, it is open, whether FPR* can define the isomorphism 
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problem for CFI-structures generalised to Z 4 . A negative answer to this last question would 
provide a class of structures on which FPR* is strictly weaker than Choiceless Polynomial 
Time (which captures Ptime on this class [Tj). 

Another question concerns the relationship between solvability logic FPS and rank logic 
FPR*. Our proof of Lemma [?] shows that on every class of structures of bounded colour 
class size the two logics have the same expressive power. However, over general structures 
this reduction fails. We only know, by our results from Section^ that a simulation of rank 
operators by solvability quantifiers would require counting. 

Finally, we think it is worth to explore the connections between our approach and the 
game-theoretic approach proposed by Dawar and Holm in [5] to see to what extent our 
methods can be combined. For example, what kind of properties does a variant of their 
partition games have for infinitary logics with solvability quantifiers? 

- References - 

1 F. Abu Zaid, E. Gradel, M. Grohe, and W. Pakusa. Choiceless Polynomial Time on 
structures with small Abelian colour classes. I 11 MFCS 2014, volume 8634 of Lecture Notes 
in Computer Science, pages 50-62. Springer, 2014. 

2 A. Atserias, A. Bulatov, and A. Dawar. Affine systems of equations and counting infinitary 
logic. Theoretical Computer Science, 410:1666-1683, 2009. 

3 G. Buntrock, U. Hertrampf, C. Damm, and C. Meinel. Structure and importance of 
logspace-mod-classes. STAGS ’91, pages 360-371, 1991. 

4 J. Cai, M. Fiirer, and N. Immerman. An optimal lower bound on the number of variables 
for graph identification. Combinatorica, 12(4):389-410, 1992. 

5 A. Dawar. The nature and power of fixed-point logic with counting. ACM SIGLOG News, 
pages 8-21, 2015. 

6 A. Dawar, E. Gradel, B. Holm, E. Kopczynski, and W. Pakusa. Definability of linear 
equation systems over groups and rings. Logical Methods in Computer Science, 9(4), 2013. 

7 A. Dawar, M. Grohe, B. Holm, and B. Laubner. Logics with Rank Operators. In LICS ’09, 
pages 113-122. IEEE Computer Society, 2009. 

8 A. Dawar and B. Holm. Pebble games with algebraic rules. I 11 Automata, Languages, and 
Programming, pages 251-262. Springer, 2012. 

9 H.-D. Ebbinghaus and J. Flum. Finite model theory. Springer-Verlag, 2nd edition, 1999. 

10 E. Gradel et al. Finite Model Theory and Its Applications. Springer, 2007. 

11 M. Grohe. The quest for a logic capturing PTIME. I 11 LICS 2008, pages 267-271, 2008. 

12 Y. Gurevich and S. Shelah. O 11 finite rigid structures. The Journal of Symbolic Logic, 
61(02):549-562, 1996. 

13 M. Hall. The theory of groups. American Mathematical Soc., 1976. 

14 U. Hertrampf, S. Reith, and H. Vollmer. A note on closure properties of logspace mod 
classes. Information Processing Letters, 75(3):91 93, 2000. 

15 B. Holm. Descriptive complexity of linear algebra. PhD thesis, University of Cambridge, 
2010 . 

16 B. Laubner. The structure of graphs and new logics for the characterization of Polynomial 
Time. PhD thesis, Humboldt-Universitat Berlin, 2011. 

17 M. Otto. Bounded variable logics and counting: A study in finite models. 1997. 

18 W. Pakusa. Finite model theory with operators from linear algebra. Staatsexamensarbeit, 
RWTH Aachen University, 2010. 

19 C. Papadimitriou. Computational complexity. Addison-Wesley, 1995. 

20 J. Toran. O 11 the hardness of graph isomorphism. SIAM Journal on Computing, 33(5):1093- 
1108, 2004. 




